About

Aparajit Lal Kumar is a highly experienced Staff Data Engineer with a strong background in designing and developing big data pipelines using cutting-edge technologies such as Kafka, Spark, Hive, Pig, Sqoop, and Airflow. With over 6 years of relevant experience in the industry, Aparajit has a proven track record of delivering scalable and efficient data solutions that meet business requirements. Apart from his expertise in data engineering, Aparajit is also proficient in Java, Scala, Shell, and Python programming languages. He has experience working with complex SQL queries, enterprise schedulers, and developing tests for unit, functional, and load testing. Currently, Aparajit is working as a Senior Data Engineer at Visa, where he is responsible for designing and developing big data pipelines using Spark, Hive, Pig, Kafka, Sqoop, and Airflow. He has also worked on data modeling and integrating monitoring with TS DB. In addition, Aparajit has experience in DevOps, including CI/CD pipelines, Jenkins, Kubernetes, monitoring, alerting, GitHub, and Bitbucket. Prior to his current role, Aparajit held positions as a System Analyst and Associate Systems Analyst at Visa, where he gained experience in architecture redesign, data engineering best practices, and automation of maintenance activities. He also has experience in debugging and performance tuning of production jobs, creating Hive jobs for analysis, and scheduling jobs in CA Workstation and MVS. Aparajit holds a Master of Technology (MTech) in Software Systems Data Analytics from Birla Institute of Technology and Science, Pilani, and a Bachelor of Engineering (BE) in Computer Science and Engineering from Mepco Schlenk Engineering College, Sivakasi, Tamilnadu. He also completed his HSLC in Computer Science from TVS Matriculation Higher Secondary School. Aparajit's technical skills include data engineering, AI, Kafka, Spark, Apache Airflow, CI/CD, Big Data, Kubernetes, SQL, Jenkins, DevOps, Java, Python, Scala, Apache Hive, MySQL, and infra. With his diverse skill set and experience, Aparajit is a valuable asset to any organization looking to build scalable and efficient data solutions.